State-based auxiliary display operation

ABSTRACT

Described is a technology by which routing of data may be automatically modified based on detected state data of a computing system. For example, user input may be routed from an actuator set to a host computer system when the host computer system is in an online state, or to an auxiliary computing device when the host computer system is offline. State may be determined based on one or more various criteria, such as online or offline, laptop lid position, display orientation, current communication and/or other criteria. The auxiliary display and/or actuator set may be embedded in the host computer system, or each may be separable from it or standalone, such as a remote control or cellular phone.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/195,023 filed on Jun. 28, 2016, entitled “STATE-BASED AUXILIARYDISPLAY OPERATION,” which is a continuation of U.S. patent applicationSer. No. 14/721,134 filed on May 26, 2015, entitled “STATE-BASEDAUXILIARY DISPLAY OPERATION,” which issued as U.S. Pat. No. 9,383,830 onJul. 5, 2016, which is a continuation of U.S. patent application Ser.No. 14/600,209 filed on Jan. 20, 2015, entitled “STATE-BASED AUXILIARYDISPLAY OPERATION,” which issued as U.S. Pat. No. 9,063,584 on Jun. 23,2015, which is a continuation of U.S. patent application Ser. No.14/244,272 filed on Apr. 3, 2014, entitled “STATE-BASED AUXILIARYDISPLAY OPERATION,” which issued as U.S. Pat. No. 8,959,259 on Feb. 17,2015, which is a continuation of U.S. patent application Ser. No.11/366,682 filed on Mar. 2, 2006, entitled “STATE-BASED AUXILIARYDISPLAY OPERATION,” which issued as U.S. Pat. No. 8,692,816 on Apr. 8,2014, which claims the benefit of U.S. Provisional Patent ApplicationNo. 60/674,203 filed on Apr. 22, 2005 and U.S. Provisional PatentApplication No. 60/674,204 filed on Apr. 22, 2005. This applicationexpressly incorporates herein the entirety of each of the foregoingapplications.

BACKGROUND

The concept of auxiliary processing and auxiliary mechanisms thatprovide some auxiliary computing functionality to a main (host) computersystem are generally described in a number of United States patentapplications assigned to the assignee of the present invention,including Ser. Nos. 10/429,930 and 10/429,932. In general, many of theseauxiliary computing concepts are embodied in various types of auxiliarydisplays, sometimes comprising a small display device embedded in apersonal computer form factor, but also embodied in many other devicessuch as mobile phones, remote control devices, and so forth. Auxiliarydisplays can show independent data, e.g., related to another purposesuch as mobile phone data, or show-computer-related data, such as emailand calendar appointments of a host personal computer, even when thehost computer system (e.g., a personal computer) is off or in some otherreduced-power state.

To allow a user to interact with/navigate the content displayed on anauxiliary display device, some set of one or more actuators is required.Consideration needs to be given as to how a user will interact with theactuator set, what should occur when the user does, and what the displayis currently rendering. For example, if interacting with an auxiliarydisplay embedded in a laptop computer, the actuators generally need tobe positioned somewhere proximate the auxiliary display so that userscan intuitively use them, including when the laptop lid is closed.

BRIEF SUMMARY

This Summary is provided to introduce a selection of representativeconcepts in a simplified form that are further described below in theDetailed Description. This Summary is not intended to identify keyfeatures or essential features of the claimed subject matter, nor is itintended to be used in any way that would limit the scope of the claimedsubject matter.

Briefly, various aspects of the subject matter described herein aredirected towards modifying the operation of an actuator set and/or anauxiliary computing device that are capable of being coupled to a hostcomputer system based on detected state data. For example, input may berouted from the actuator set to the auxiliary computing device when thehost computer system is in an offline (e.g., reduced power, such as off,asleep or possibly in a screen saver mode) state, or may be routed tothe host computer system when the host computer system is in an onlinestate. State may be determined based on one or more various criteria,such as a laptop lid position, an orientation of a display, a manualoverride, a currently executing program, communication between the hostcomputer system and auxiliary computing device, and so forth.

By having host computer system and an auxiliary device, an actuator setmay be configured for coupling to the host computer to enableinteraction with the host computer when the host computer is capable ofreceiving data corresponding to input signals received via the actuatorset. Alternatively, the actuator set may be configured for coupling tothe auxiliary device to enable interaction with the auxiliary devicewhen the auxiliary device is capable of receiving data corresponding toinput signals received via the actuator set. By detecting state dataincluding state data related to communication capability between anauxiliary device and a host computer system, the operation of theauxiliary device, e.g., its display, and/or interactivity of an actuatorset, may be controlled based on the state data.

Other advantages may become apparent from the following detaileddescription when taken in conjunction with the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example and not limitedin the accompanying figures in which like reference numerals indicatesimilar elements and in which:

FIG. 1 shows an illustrative example of a general-purpose computingenvironment into which various aspects of the present invention may beincorporated.

FIG. 2 is a representation of a laptop host computer system having amultiple-use actuator that provides interaction functionality with thehost computer and with an auxiliary display coupled to the host computersystem.

FIG. 3 is a representation of a laptop host computer system having amultiple-use actuator that may provide interaction functionality withthe auxiliary display when the laptop lid is closed.

FIG. 4 is a representation of a laptop host computer system having amultiple-use actuator that may provide interaction functionality withthe host computer operating system when the laptop lid is open.

FIG. 5 is a block diagram generally representing components for handlinginput from the actuator set based on a state of the host computersystem.

FIGS. 6A-6D are representations of a mobile telephone that changesauxiliary display and/or actuator functionality based on a communicationstate of the mobile telephone.

FIGS. 7A-7C are representations of a remote control device that changesauxiliary display and/or actuator functionality based on a currentoperating state.

FIGS. 8A and 8B are representations of computer system with a detachableauxiliary display that changes actuator functionality based on a currentoperating state.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Exemplary Operating Environment

FIG. 1 illustrates an example of a suitable computing system environment100 on which the invention may be implemented. The computing systemenvironment 100 is only one example of a suitable computing environmentand is not intended to suggest any limitation as to the scope of use orfunctionality of the invention. Neither should the computing environment100 be interpreted as having any dependency or requirement relating toany one or combination of components illustrated in the exemplaryoperating environment 100.

The invention is operational with numerous other general purpose orspecial purpose computing system environments or configurations.Examples of well known computing systems, environments, and/orconfigurations that may be suitable for use with the invention include,but are not limited to: personal computers, server computers, hand-heldor laptop devices, tablet devices, multiprocessor systems,microprocessor-based systems, set top boxes, programmable consumerelectronics, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of the above systemsor devices, and the like.

The invention may be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a computer. Generally, program modules include routines,programs, objects, components, data structures, and so forth, whichperform particular tasks or implement particular abstract data types.The invention may also be practiced in distributed computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. In a distributed computingenvironment, program modules may be located in local and/or remotecomputer storage media including memory storage devices.

With reference to FIG. 1, an exemplary system for implementing theinvention includes a general purpose computing device in the form of acomputer 110. Components of the computer 110 may include, but are notlimited to, a processing unit 120, a system memory 130, and a system bus121 that couples various system components including the system memoryto the processing unit 120. The system bus 121 may be any of severaltypes of bus structures including a memory bus or memory controller, aperipheral bus, and a local bus using any of a variety of busarchitectures. By way of example, and not limitation, such architecturesinclude Industry Standard Architecture (ISA) bus, Micro ChannelArchitecture (MCA) bus, Enhanced ISA (EISA) bus, Video ElectronicsStandards Association (VESA) local bus, and Peripheral ComponentInterconnect (PCI) bus also known as Mezzanine bus.

The computer 110 typically includes a variety of computer-readablemedia. Computer-readable media can be any available media that can beaccessed by the computer 110 and includes both volatile and nonvolatilemedia, and removable and non-removable media. By way of example, and notlimitation, computer-readable media may comprise computer storage mediaand communication media. Computer storage media includes volatile andnonvolatile, removable and non-removable media implemented in any methodor technology for storage of information such as computer-readableinstructions, data structures, program modules or other data. Computerstorage media includes, but is not limited to, RAM, ROM, EEPROM, flashmemory or other memory technology, CD-ROM, digital versatile disks (DVD)or other optical disk storage, magnetic cassettes, magnetic tape,magnetic disk storage or other magnetic storage devices, or any othermedium which can be used to store the desired information and which canaccessed by the computer 110. Communication media typically embodiescomputer-readable instructions, data structures, program modules orother data in a modulated data signal such as a carrier wave or othertransport mechanism and includes any information delivery media. Theterm “modulated data signal” means a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, and not limitation, communicationmedia includes wired media such as a wired network or direct-wiredconnection, and wireless media such as acoustic, RF, infrared and otherwireless media. Combinations of the any of the above should also beincluded within the scope of computer-readable media.

The system memory 130 includes computer storage media in the form ofvolatile and/or nonvolatile memory such as read only memory (ROM) 131and random access memory (RAM) 132. A basic input/output system 133(BIOS), containing the basic routines that help to transfer informationbetween elements within computer 110, such as during start-up, istypically stored in ROM 131. RAM 132 typically contains data and/orprogram modules that are immediately accessible to and/or presentlybeing operated on by processing unit 120. By way of example, and notlimitation, FIG. 1 illustrates operating system 134, applicationprograms 135, other program modules 136 and program data 137.

The computer 110 may also include other removable/non-removable,volatile/nonvolatile computer storage media. By way of example only,FIG. 1 illustrates a hard disk drive 141 that reads from or writes tonon-removable, nonvolatile magnetic media, a magnetic disk drive 151that reads from or writes to a removable, nonvolatile magnetic disk 152,and an optical disk drive 155 that reads from or writes to a removable,nonvolatile optical disk 156 such as a CD ROM or other optical media.Other removable/non-removable, volatile/nonvolatile computer storagemedia that can be used in the exemplary operating environment include,but are not limited to, magnetic tape cassettes, flash memory cards,digital versatile disks, digital video tape, solid state RAM, solidstate ROM, and the like. The hard disk drive 141 is typically connectedto the system bus 121 through a non-removable memory interface such asinterface 140, and magnetic disk drive 151 and optical disk drive 155are typically connected to the system bus 121 by a removable memoryinterface, such as interface 150.

The drives and their associated computer storage media, described aboveand illustrated in FIG. 1, provide storage of computer-readableinstructions, data structures, program modules and other data for thecomputer 110. In FIG. 1, for example, hard disk drive 141 is illustratedas storing operating system 144, application programs 145, other programmodules 146 and program data 147. Note that these components can eitherbe the same as or different from operating system 134, applicationprograms 135, other program modules 136, and program data 137. Operatingsystem 144, application programs 145, other program modules 146, andprogram data 147 are given different numbers herein to illustrate that,at a minimum, they are different copies. A user may enter commands andinformation into the computer 110 through input devices such as atablet, or electronic digitizer, 164, a microphone 163, a keyboard 162and pointing device 161, commonly referred to as mouse, trackball ortouch pad. Other input devices not shown in FIG. 1 may include ajoystick, game pad, satellite dish, scanner, or the like. These andother input devices are often connected to the processing unit 120through a user input interface 160 that is coupled to the system bus,but may be connected by other interface and bus structures, such as aparallel port, game port or a universal serial bus (USB). A monitor 191or other type of display device is also connected to the system bus 121via an interface, such as a video interface 190. The monitor 191 mayalso be integrated with a touch-screen panel or the like. Note that themonitor and/or touch screen panel can be physically coupled to a housingin which the computing device 110 is incorporated, such as in atablet-type personal computer. In addition, computers such as thecomputing device 110 may also include other peripheral output devicessuch as speakers 195 and printer 196, which may be connected through anoutput peripheral interface 194 or the like.

The computer 110 may operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer180. The remote computer 180 may be a personal computer, a server, arouter, a network PC, a peer device or other common network node, andtypically includes many or all of the elements described above relativeto the computer 110, although only a memory storage device 181 has beenillustrated in FIG. 1. The logical connections depicted in FIG. 1include a local area network (LAN) 171 and a wide area network (WAN)173, but may also include other networks. Such networking environmentsare commonplace in offices, enterprise-wide computer networks, intranetsand the Internet.

When used in a LAN networking environment, the computer 110 is connectedto the LAN 171 through a network interface or adapter 170. When used ina WAN networking environment, the computer 110 typically includes amodem 172 or other means for establishing communications over the WAN173, such as the Internet. The modem 172, which may be internal orexternal, may be connected to the system bus 121 via the user inputinterface 160 or other appropriate mechanism. In a networkedenvironment, program modules depicted relative to the computer 110, orportions thereof, may be stored in the remote memory storage device. Byway of example, and not limitation, FIG. 1 illustrates remoteapplication programs 185 as residing on memory device 181. It may beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused.

An auxiliary display subsystem 199 may be connected via the userinterface 160 to allow data such as program content, system status andevent notifications to be provided to the user, even if the mainportions of the computer system are in a low power state. The auxiliarydisplay subsystem 199 may be connected to the modem 172 and/or networkinterface 170 to allow communication between these systems while themain processing unit 120 is in a low power state.

State-Based Auxiliary Device Operation

Various aspects of the technology described herein are directed towardsautomatically changing auxiliary device operation based on one or morecurrent state settings, including handling the input from a set ofactuators to work in one of a plurality ways depending on a currentstate. For example, given a host computer system in the form of a laptopwith an integrated auxiliary display, the actuators input may be routedto the host computer's operating system when the laptop lid is open, androuted to the auxiliary display device when the laptop lid is closed. Ingeneral, some of the description herein is directed towards such aparticular example. However, numerous other types of configurations andarrangements are feasible, including one in which a user manuallyselects where an actuators input is directed.

Another example includes a mobile phone that changes its operationdepending on whether and how the mobile phone is currently communicatingwith a radio tower, with a host computer and/or during a phone call. Yetanother example is generally directed towards a detachable and/orstandalone device such as a remote control device having actuators thatoperate in one way when physically coupled (docked) to a host computersystem, another way when coupled wirelessly coupled, and yet another waywhen coupled to a media device. For example, a remote control mayproduce a signal that is detected by the host computer system and entersthe host computer system into a media consumption mode (e.g., to play amovie). Connections qualify as a state as well, whether wired orwireless, such as headphones plugged in or not plugged in (orcommunicating if wireless).

Moreover, while an auxiliary display device may be of the type that iscoupled to a host computer system by being physically built into thehousing, e.g., in a laptop, other types of auxiliary devices andactuators may similarly leverage the technology described herein,including devices not conventionally thought of as being“computer-system” peripherals. Such devices include television sets,audio receivers, audio/video recorders, telephones, a separate computer,a mobile communications device, a secondary display screen withactuators, a watch, a wall (e.g., kitchen) display, a display screen, adigital picture frame, a clock, a radio, a media player, a deviceembedded within or using the main display of a consumer electronicsdevice, automotive, transportation or other vehicular units, keyboardsor other input devices of the main computer system, a pager, a personaldigital assistant, and so forth. As such, the present invention is notlimited to the examples, structures or functionality described herein;rather, any of the examples, structures or functionality describedherein are non-limiting, and the present invention may be used variousways that provide benefits and advantages in computing and device usagein general.

Turning to FIG. 2 of the drawings, there is shown an example design fora laptop-style host computer system 210 (or the like, such as atablet-based personal computer), having a design that reduces theoverall number of actuators. As can be readily appreciated, the hostcomputer system 210 and embedded auxiliary display 220 may be based onthe computer system 110 represented in FIG. 1, with the auxiliarydisplay 220 of FIG. 2 being a component of the auxiliary subsystem 199of FIG. 1.

To simplify the main computer system 210 for various reasons, includingaesthetics, ease of use and to have a reduced number of components andwiring that lower the cost, a set of one or more actuators 230 may beprovided that have multiple uses. For example, one such actuator set 230may be used for operating system/application program interaction (e.g.,navigation) when the host computer system is online, (that is, theoperating system, e.g., Microsoft Windows® is running), and foralternatively interacting with programs/pages of the auxiliary displaywhen the main computer system is offline (that is, the operating systemnot fully operational, typically because of a reduced power state). Inother words, when online the operating system can be considered as beingin control of the actuator set 230, while when offline the auxiliarydisplay can be considered as being in control of the actuator set 230.Note that when online, the input of the actuator set 230 may be providedto the host computer operating system, but routed for user interactionwith other programs that are running, e.g., the operating systemprovides the input or related data that corresponds to the input anapplication program having focus, (or even to an auxiliary deviceprogram).

In the example implementation of FIG. 2, the actuator set 230 comprisesa jog dial control that is used as a dual-functioninteraction/navigation mechanism; (the curved arrow to the right of thearrow jog dial control 230 is to indicate the primary directions ofmovement, and is of course not part of the system). Such a jog dialcontrol is mounted such that it is accessible whether the laptop lid 250is open or closed, whereby its multiple-use capabilities are readilyapparent. Note that while a jog dial control 230 is represented, such aninteraction/navigation mechanism may comprise any set of actuators(e.g., a D-pad, joystick, scroll wheel and so forth), as long as it isplaced in such a way that it is reasonably accessible for auxiliarydisplay navigation and for use by the host system 210 when the maincomputer system's operating system is running, or can be adjusted to beaccessible (optimally) for either use mode.

As can be readily appreciated, changing the actuator input based ononline or offline state is only one possible mode of operation, andother modes are also possible. For example, the host computer system 210may be online, but may be placed in a state (e.g., by a user or process)in which the actuator set 230 is configured for direct or indirectinteraction with the auxiliary display 220.

Note that other actuators 240 may be present that are not ordinarilyshared between the host computer system 210 and the auxiliary display220. For example, the actuators 240 in FIG. 2 are typically forauxiliary display navigation, as they are built into the laptop lid 250and thus not readily accessible for ordinary use when the laptop lid 250is open.

As mentioned above, the present invention is quite applicable totablet-based personal computers, as such devices typically have a set ofnavigation controls similar to an auxiliary display device's controls.Such controls may be multiple-purpose controls, as described above. Forexample, as also mentioned above, in the main computer online state, theuser, process or some other state change mechanism may enable a togglefeature that selects whether the actuator set is controlling(interacting with) the host computer system 210 or the auxiliary display220. This may be relevant for situations in which a user wants tonavigate the auxiliary display's user interface while the operatingsystem is still running; for example, using a convertible tablet-basedcomputer, a user can rotate the display so it is facing other people ina meeting, such as to show a presentation (e.g., Microsoft® PowerPoint®)deck, with the user controlling the presentation (e.g., selecting thenext slide) from the auxiliary display on the back of the screen. Notethat the orientation of the main display and/or the application programthat is running can be detected as a current state that changesoperation of the auxiliary device display and/or an actuator set.

Various alternatives for providing an actuator set may be provided, asgenerally represented with reference to FIGS. 3 and 4. FIGS. 3 and 4generally show a laptop host computer system 211 configured such thatthe same auxiliary display 220 and actuator set 231 (such as generallyin the form of a D-pad switch) may be used whether the lid is closed(FIG. 3) or open (FIG. 4). Note that a jog dial control 230 is notshown, but may be present, as may any other types of actuators. As canbe readily appreciated, the laptop lid position, which often (but notnecessarily) corresponds to an offline state (closed) and an onlinestate (open), may be sensed independently or in conjunction with theoffline/online for purposes of determining operation of the auxiliarydevice, i.e., its display and/or actuator set.

FIG. 5 is a block diagram representing some example components that maybe used to implement various aspects of the present invention. Asrepresented in the example of FIG. 5, an auxiliary display 220 couplesvia an interface 522 to an auxiliary subsystem 534, generally comprisingprocessing and memory components. In general, the auxiliary subsystem534 allows the auxiliary display 220 to operate while the main hostcomputer system 210 is offline, and may also communicate with the mainhost computer system 210 while online.

As also represented in FIG. 5, the actuator set 230 couples to actuatorhandling logic 536 via one or more suitable interfaces (e.g., a driver)538. When the host computer system 210 is online, the actuator handlinglogic 536 can communicate (e.g., via events) with the host computersystem 210, primarily to provide information corresponding to actuatorinput data to the host computer system 210, such as to its operatingsystem. Note that alternatively, actuator input-related data may be fedto the host computer system 210 through the auxiliary subsystem 534,which is generally already configured to provide events to the hostcomputer system 210.

When online, the host computer system 210 can send data (e.g.,configured as structured or interlinked pages pages or the like) to theauxiliary subsystem 534 for rendering on the auxiliary display 220. Inthis manner, the host computer system 210 can control the output of theauxiliary display 220 in response to events received, including eventsthat correspond to interaction with the actuator set 230. Note that thehost computer system 210 also may control the output of the auxiliarydisplay 220 in response to other events and other user input, e.g.,conventional keyboard and mouse input, received emails, calendar events,phone (caller-ID) events, other state changes such as loss of networkconnectivity, power state change and so forth.

When online, the host computer system 210 can also instruct the actuatorhandling logic 536 to be used to control the operation of the auxiliarydisplay 220 independent of the host computer system 210, e.g., as if thehost computer system 210 was offline, until otherwise instructed. Otherstate data 540 can also be used for this purpose, e.g., a lid switch 542can provide its state, as well as other controls and sensors 544, suchas one that indicates whether a tablet PC screen is in a rotated state,and so forth. Note that the state data 540 may include information as towhether the host computer system 210 is in a screen saver ordisplay-power-down mode, (which may be considered a form of beingoffline), and/or what program is currently being run; for example, theauxiliary display subsystem 534 may behave differently when apresentation program is being run with respect to when another programis run. Still other possible state data includes proximity sensing, whena device (e.g., Bluetooth®) is in out of range, the availability of oneor more other communication mechanisms (e.g., GSM, radio, Bluetooth®,WiFi), time-of-day, whether a phone call is detected, and so forth.

User preferences 546, e.g., comprising rules, defaults, and/or otherinformation, also may be a factor in determining operation of theauxiliary device, including whether and how to route input from theactuator set 230. Such preference data 546 or a subset thereof may beconfigured or overridden by the host computer system 210 when online,and may be maintained in the auxiliary processing and memory subsystem534 so that it is available for offline use. Essentially any piece orcombination of state data 540, and user preferences/overrides 546 can beused to determine whether the host computer system 210 or the auxiliaryprocessing and memory subsystem 534 controls what content is displayed,and how the auxiliary handling logic 536 operates to route actuator setinput.

When the host computer system is offline, or otherwise acts as such withrespect to input from the actuator set 230, the auxiliary subsystem 534directly controls the content displayed on the auxiliary display 220.This may be accomplished in various ways, such as by having the actuatorhandling logic provide interaction (navigation) events to an auxiliaryprogram (e.g., operating system) running on the auxiliary subsystem 534(instead of to the main computer system 210, or to both, with the maincomputer system simply not handling the events). Note that the auxiliarysubsystem 534 is available for use because offline content may cached inan auxiliary memory, and because the auxiliary processor, memory andactuator handling logic 534 have power maintained thereto, whereby theactuator handling logic 534 has the ability to generate events to arunning auxiliary program even when the host computer system 210 ispowered down to some extent. As can be readily appreciated, othervarious state data 540 as evaluated against user preferences 546 or thelike may control or override operation, e.g., a system may be configuredto not use the auxiliary display 220 when power is critically low.

As can be readily appreciated, various ways to handle input data may bealternatively implemented. For example, instead of actuator handlinglogic 536, the actuator set 230 can be coupled (via one or moreinterfaces) to both to the host computer system 210 and to the auxiliarysubsystem 534. When the host computer system 210 is online, theauxiliary processing subsystem 534 can ignore user interaction eventsreceived from the actuator set 230, essentially deferring to the hostcomputer system 210, which can route them back as desired. When offline,the auxiliary processing subsystem 534 accepts the user interactionevents and operates based on them, with the host computer system 210 notbeing operational to handle such events, thereby precluding conflicts.

FIGS. 6A-6D exemplify another type of state-based change, namelychanging actuator set and/or auxiliary display device operation based oncurrent connectivity with a host computer 210 and/or other receiver. Forexample, FIG. 6A shows connectivity via an auxiliary display device inthe form of a mobile phone 660 having a display 662 physically docked toa base 664 coupled in some way (wired or wireless) to the host computersystem 210. In such a docked mode, the display 662 and actuator set 663,(or some part of each or both), as well as one or more programs (e.g.,synchronization-related programs), may operate in a corresponding mode,e.g., according to this state and user preferences.

FIG. 6B represents an undocked mode, in which the mobile telephone 660is still (e.g., wirelessly) coupled and communicating with the hostcomputer system 210. In this state, the actuator set 663 can controloperation of the host computer system 210 instead of the device 660, andthe display 662 can be controlled by the host computer system 210. Forexample, in this mode, dialing a telephone number on the device'sactuator set 663 may result in the personal computer placing a lessexpensive landline (e.g., POTS or VoIP) call instead of making a mobiletelephone call. Note that the user may configure such a mode to operateregardless of whether the mobile device 660 is within range of a radiotower.

FIG. 6C exemplifies a mode in which the device 660 is coupled to aconnected caller/recipient 668 via a tower 668, as well as coupled tothe host computer system in some way. Auxiliary device operation maychange according to this mode, e.g., the actuator set may remaindirected towards mobile phone operation, while the display may change(or not), and another operation such as host-device data synchronizationmay take place.

FIG. 6D exemplifies another possible mode in which the device 660 isdecoupled from the host computer system 210, but remains incommunication with a radio tower 668, regardless of whether alsoconnected to a caller/recipient. In such a mode, the device acts as aconventional mobile phone/wireless data device. However, the device mayalso be used for display and interaction with cached auxiliary contentpreviously provided by the host computer system 210.

Yet another example is represented in FIGS. 7A-7C, in which a remotecontrol device 770 for a media-related device 778 (e.g., anaudiovisual-related device such as a television or audio receiver) orthe like may operate differently based on a current state. Note thatsuch a remote control device 770 may control the media device throughthe host computer, e.g., the host computer system may be configured as amedia center, such as via Microsoft Corporation's Windows® Media CenterEdition operating system. Such a remote control may be docked in a base774 coupled to the computer system 210, in which event the display 772and/or actuator set 773, (or some part of each), may be in a mode inwhich the host computer system 210 controls the operation.

FIG. 7B shows an undocked state where the device 770 is stillcommunicating with the host computer system 201, which may correspond toa different mode of operation. For example, the device 770 may be set tocontrol a media player via infrared output, but may receivenotifications and other data from the computer system. FIG. 7B shows aconventional remote-control operating mode in which the remote controldevice 770 is controlling a media-related device 778, independent (asrepresented by the “?” in FIG. 7C) of whether also coupled to the hostcomputer system. For example, such a device 770 may be configured tochange a television channel directly on a television receiver withoutnecessarily needing to go through the host computer system 210.

As can be readily appreciated, instead of having an actuator set thataccompanies an auxiliary display, an actuator set may be fixed withrespect to a host computer system, while the auxiliary display isremovable. FIGS. 8A and 8B show one such example, where the actuator set233 is physically part of the host computer system 213 that may becoupled to a detachable auxiliary display. Note that while FIGS. 8A and8B exemplify an auxiliary display implemented in the form of adetachable card 223, such as a PCMCIA card or the like that showsthrough a transparent surface 890 (FIG. 8B) when inserted (FIG. 8A),other display devices such as a wired or wireless (e.g., USB-based)auxiliary display are equivalent.

In such a situation, the operation of the actuator set may change basedon whether the auxiliary display is attached or detached. For example,the actuator set 233 may be configured to interact with content renderedon the auxiliary display 223 when it is inserted as in FIG. 8A, or withthe operating system of the host computer 213 when the auxiliary display223 is removed, as in FIG. 8B.

To this end, when the detachable display component (e.g., card)comprises the auxiliary subsystem memory and processing components,input data corresponding to actuator set user input may be providedthereto. In the event the detachable display component is only adisplay, with the auxiliary subsystem memory and processing componentsaccompanying the actuator set, the display data as modified by theactuator signals may be sent rather than the actuator data.

Note that an auxiliary display may be presented on a subset (e.g., in awindow) of a main display of a host computer system. If so, an actuatorset can change its effective operating behavior (e.g., where its inputis routed) based on whether the auxiliary display is currently beingshown or is hidden, minimized or closed.

While the invention is susceptible to various modifications andalternative constructions, certain illustrated embodiments thereof areshown in the drawings and have been described above in detail. It shouldbe understood, however, that there is no intention to limit theinvention to the specific forms disclosed, but on the contrary, theintention is to cover all modifications, alternative constructions, andequivalents falling within the spirit and scope of the invention.

What is claimed is:
 1. A computer system comprising: a display; one ormore detachable remote control devices; one or more processors; and oneor more computer-readable hardware storage media having stored thereoncomputer-executable instructions, the computer-executable instructionsbeing executable by the one or more processors to cause the computersystem to: determine a physical connection status between the computersystem and an auxiliary display device; based on the physical connectionstatus, display content on one or more of the computer system's displayor the auxiliary display device; access state data of the one or moredetachable remote control devices, the state data including informationcorresponding to a physical position of the one or more detachableremote control devices; receive input from the one or more detachableremote control devices; and based at least partially on the receivedinput from the one or more detachable remote control devices, manipulatethe displayed content that is being displayed on the one or more of thecomputer system's display or the auxiliary display device, whereinmanipulating the displayed content is based at least partially on thephysical position of the one or more detachable remote control devices.2. The computer system of claim 1, wherein the one or more detachableremote control devices include a D-pad controller.
 3. The computersystem of claim 1, wherein the one or more detachable remote controldevices include a joystick.
 4. The computer system of claim 1, whereinthe one or more detachable remote control devices include one or morebuttons and a joystick.
 5. The computer system of claim 1, wherein thecomputer system and the auxiliary display device are connected at leastpartially via a universal serial bus connection.
 6. The computer systemof claim 1, wherein the computer system's display is an integrateddisplay.
 7. The computer system of claim 1, wherein the auxiliarydisplay device is a television set.
 8. The computer system of claim 1,wherein the one or more detachable remote control devices are mountableon a side portion of the computer system.
 9. The computer system ofclaim 1, wherein the computer system is a tablet-based computer.
 10. Thecomputer system of claim 1, wherein the auxiliary display device isphysically coupled to the computer system via a docking base.
 11. Thecomputer system of claim 1, wherein, in addition to the one or moredetachable remote control devices, the computer system also includes astandalone remote control device, the standalone remote control devicecommunicating with the computer system via a wireless connection.
 12. Amethod implemented by one or more processors of a computer system, thecomputer system comprising a display and one or more detachable remotecontrol devices, the method comprising: determining a physicalconnection status between the computer system and an auxiliary displaydevice; based on the physical connection status, displaying content onone or more of the computer system's display or the auxiliary displaydevice; accessing state data of the one or more detachable remotecontrol devices, the state data including information corresponding to aphysical position of the one or more detachable remote control devices;receiving input from the one or more detachable remote control devices;and based at least partially on the received input from the one or moredetachable remote control devices, manipulating the displayed contentthat is being displayed on the one or more of the computer system'sdisplay or the auxiliary display device, wherein manipulating thedisplayed content is based at least partially on the physical positionof the one or more detachable remote control devices.
 13. The method ofclaim 12, wherein the one or more detachable remote control devicesincludes a D-pad controller and a joystick.
 14. The method of claim 12,wherein the computer system and the auxiliary display device areconnected at least partially via a universal serial bus connection. 15.The method of claim 12, wherein the computer system is a tablet-basedcomputer system, and wherein the computer system's display is anintegrated display of the tablet-based computer system.
 16. The methodof claim 12, wherein the auxiliary display device is a television setthat is connected to the computer system via a docking base.
 17. Themethod of claim 12, wherein the one or more detachable remote controldevices are mounted on a side of the computer system.
 18. The method ofclaim 12, wherein, in addition to the one or more detachable remotecontrol devices, the computer system also includes a standalone remotecontrol device, the standalone remote control device communicating withthe computer system via a wireless connection.
 19. A computer systemcomprising: a display; a detachable remote control device; one or moreprocessors; and one or more computer-readable hardware storage mediahaving stored thereon computer-executable instructions, thecomputer-executable instructions being executable by the one or moreprocessors to cause the computer system to: determine that the computersystem is operating according to a first mode; after being physicallyconnected to an auxiliary display device, determine that the computersystem is operating according to a second mode, the computer systemchanging from the first mode of operation to the second mode ofoperation in response to the computer system being physically connectedto the auxiliary display device; determine that a power state of thecomputer system has changed in response to the computer system beingphysically connected to the auxiliary display device; access state dataof the detachable remote control device, the state data includinginformation corresponding to a physical position of the detachableremote control device; based on the power state change of the computersystem and the second mode of operation, display content on theauxiliary display device; receive input from the detachable remotecontrol device; and based at least partially on the received input fromthe detachable remote control device, manipulate the displayed contentthat is being displayed on the auxiliary display device, whereinmanipulating the displayed content is based at least partially on thephysical position of the detachable remote control device.
 20. Thecomputer system of claim 19, wherein a resolution of the auxiliarydisplay device is different than a resolution of the computer system'sdisplay device.
 21. The computer system of claim 20, wherein theauxiliary display device is a television set that is connected to thecomputer system via a docking base.
 22. The computer system of claim 19,wherein the one or more detachable remote control devices are mounted ona side of the computer system and include one or more buttons and ajoystick.